Mobile device and method for messenger-based video call service

ABSTRACT

A mobile device and method for a messenger-based video call service using camera preview image and voice information are provided. In the method, the mobile device displays a camera preview screen by executing a camera, and detects an input for selecting one or more sharers for a video call from the camera preview screen. Then, the mobile device executes a messenger for providing the video call service, transmits a connection request to the selected sharers through the messenger, and performs the messenger-based video call with the sharers in response to the connection request.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a Continuation application of U.S. patent application Ser. No.14/010,817 filed on Aug. 27, 2013 which claims the benefit under 35U.S.C. §119(a) of a Korean patent application filed on Aug. 27, 2012 inthe Korean Intellectual Property Office and assigned Serial No.10-2012-0093942, the entire disclosure of which is hereby incorporatedby reference.

BACKGROUND

1. Field of the Invention

The present disclosure relates generally to a messenger-based video callservice technology, and more particularly, to a mobile device and amethod for a messenger-based video call service using camera previewimage and voice information.

2. Description of the Related Art

With a growth of related technologies, a great variety of mobiledevices, e.g., smart phones, tablet PCs, etc. are increasingly becomingpopular these days. Mobile devices have outgrown of their respectivetraditional fields, and reached a mobile convergence stage. Not onlymany advanced functions, services and applications have been added tomobile devices, but steady improvements have also been made in variousaspects such as size, design, resolution, and user interface.

For example, one of newly added services is a messenger service, alsoreferred to as an instant messaging service, which allows real-time datatransmission between mobile devices. Typically, a messenger service canoffer multiuser chatting, photo, or video file transfer, voice call,video call, etc. through a data communication network when subscribersaccess a messenger server. With the recent advent of Wi-Fi and similartechnologies, messenger-based voice call, video call, etc. areincreasingly growing.

SUMMARY

Accordingly, the present invention is to address the above-mentionedproblems and/or disadvantages and to offer at least the advantagesdescribed below.

One aspect of the present invention is to provide a technology for amessenger-based video call service that allows two or more users toshare a camera preview image and voice information in mobile devices.

Another aspect of the present invention is to provide a mobile deviceand method for creating specific data by executing a specific functionof the mobile device while a messenger-based video call is performed,and then for sharing the created data with other mobile devices.

According to one aspect of the present invention, a method for amessenger-based video call service in a mobile device, the methodincludes: displaying a camera preview screen by executing a camerafunction; detecting an input for selecting one or more sharers for avideo call on the camera preview screen; executing a messengerapplication for initiating a messenger-based video call service;transmitting a connection request to the selected sharers through themessenger application; and performing the messenger-based video callwith the selected sharers based on the response to the connectionrequest.

According to another aspect of the present invention, provided is amobile device for a messenger-based video call service, the mobiledevice comprising a wireless communication unit configured to access amessenger server and to transmit or receive messenger data to or fromthe messenger server; a touch screen configured to display a camerapreview screen and to display a preview sharing screen restructured fromthe camera preview image; and a control unit configured to detect aninput for selecting one or more sharers for a video call from the camerapreview screen, to execute a messenger application for initiating thevideo call service, to transmit a connection request to the selectedsharers through the messenger application, and to perform themessenger-based video call with the selected sharers in response to theconnection request.

The present invention may support various functions of the mobile devicesuch as a function to enter into a messenger-based video call servicefrom a camera preview screen, a function to transmit and receive acamera preview image through a messenger application, a function toexecute a specific function of the mobile device such as image capture,a memo input, a map display, or message transmission in a video callenvironment, and a function to create and transmit specific data in avideo call environment.

Therefore, participants in a messenger-based video call service canshare additional data such as location information, handwritinginformation, message information, photo, video, etc. as well as apreview image and voice information through a messenger. This canenhance the quality of a messenger-based video call service.

Other aspects, advantages, and salient features of the invention willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses exemplary embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an example block diagram to illustrate the configuration of amobile device in accordance with an embodiment of the presentdisclosure.

FIG. 2 is a flow diagram illustrating example operations of amessenger-based video call service from a mobile device in accordancewith an embodiment of the present disclosure.

FIG. 3 illustrates example screenshots to select a member for amessenger-based video call service and send a sharing request to theselected member in accordance with an embodiment of the presentdisclosure.

FIG. 4 illustrates screenshots of a connection process for amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

FIG. 5 illustrates screenshots of an additional camera function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

FIG. 6 illustrates screenshots of a screen change function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

FIG. 7 illustrates screenshots of a camera shutter function and a datatransmission function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

FIG. 8 illustrates a screenshot of a handwriting function and a locationindication function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

FIG. 9 illustrates screenshots illustrating an ending function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

FIG. 10 illustrates a flow diagram of example operations for a cameraremote control function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

It is noted that in FIGS. 4 to 9, % S sign refers to a character stringand may be used as the name of a video call sharer. Additionally, % Nsign refers to a number and may be used to represent the number ofphotos.

DETAILED DESCRIPTION

Exemplary, non-limiting embodiments of the present disclosure aredescribed in detail with reference to the accompanying drawings. It isnoted that this disclosure may, be embodied in many different forms andshould not be construed as limited to the exemplary embodiments setforth herein.

Instead, the disclosed embodiments are provided so that this disclosurecan represent a thorough and complete description, and can convey thescope of the disclosure to those skilled in the art. The principles andfeatures of this disclosure may be employed in a variety and pluralityof embodiments without departing from the scope of the disclosure.

It is also noted that well known or widely used techniques, elements,structures, and processes may not be described or illustrated in detailto avoid obscuring the essence of the present disclosure for simplicityand clarity. Although the figures represent exemplary embodiments of thedisclosure, the figures are not necessarily drawn to scale, and certainfeatures may be exaggerated or omitted in order to better illustrate andexplain the present disclosure.

In this disclosure, a camera preview screen may not necessarilyrepresent data stored by image capturing, but may represent a screenoutput on a display unit after passing through image processing andbuffering operations. The camera preview screen may be dynamicallyadjusted according to a change in an angle of a camera lens.

It is also noted that, a preview sharing screen refers to a screenrestructured from a camera preview image and shared with one or moremobile devices through a messenger program to support a messenger-basedvideo call.

A device to which this disclosure can be applied may include all kindsof electronic devices having a camera and supporting communicationoperations, such as a mobile device, a smart phone, a tablet PC, ahandheld PC, a desktop PC, etc. Also, the device may have amulti-tasking function to simultaneously perform two or more tasks.However, it is noted that the following description is with reference tothe device of this disclosure as a mobile device.

FIG. 1 is an example block diagram to illustrate the configuration of amobile device in accordance with an embodiment of the presentdisclosure.

FIG. 1, depicts a mobile device 100. The mobile device 110 may include atouch screen 110 having a touch panel 111, and a display panel 112. Themobile device 100 may also include a hard key input unit 120, a wirelesscommunication unit 130, an audio processing unit 140, a camera 150, amemory unit 160, and a control unit 170, or any combination thereof.

In some embodiments, the touch screen 110 may include the touch panel111, and the display panel 112. The touch screen 110 may create a touchevent in response to a user's input (e.g., a user gesture, etc.) andtransmit the touch event to the control unit 170. The control unit 170may then detect the user gesture from the touch event and execute aselected function of the mobile device 100 in response to the detecteduser gesture.

A user gesture may be classified as a touch, a touch gesture, etc. Forexample, a touch gesture may include a tap, a double tap, a long tap, adrag, a drag-and-drop, a flick, a press, etc. A touch may refer to auser's action to bring a touch input tool (e.g., a finger, a stylus pen,etc.) in contact with any point on a screen (e.g., the touchscreen 110).A tap may refer to an action to touch any point on the screen and thenrelease (e.g., touch-off) the touch input tool from the touch pointwithout moving the touch input tool. A double tap may refer to an actionto tap twice any point on the screen. A long tap may refer to an actionto touch the screen relatively longer, i.e., 100 ms, than a tap, andthen releasing a touch input tool from the touch point without movingthe touch input tool. A drag may refer to an action to move a touchinput tool in an arbitrary direction while maintaining a contact withthe screen. A drag-and-drop may refer to an action to drag and thenrelease a touch input tool from the screen. A flick may refer to anaction to move a touch input tool more quickly than a drag, and thenreleasing the touch input tool. A press may refer to an action to touchand push any point on the screen through a touch input tool. It is notedthat, a touch refers to a state where any contact occurs on the touchscreen 110, and a touch gesture refers to a movement of a touch whichcontinues from touch-on to touch-off.

In some embodiments, the touch panel 111 may be placed on the displaypanel 112 (i.e., referred to as add-on type) or inserted in the displaypanel 112 (i.e., referred to as on-cell type, in-cell type, etc.). Also,the touch panel 111 may include a resistive type touch panel, acapacitive type touch panel, an electromagnetic induction type touchpanel, etc.

In some embodiments, the display panel 112 may display information inputby a user, or provided to a user as well as various menus of the mobiledevice 100. The display panel 112 may convert image data, received fromthe control unit 170, into analog signals and then display them based onone or more instructions from the control unit 170. The display panel112 may provide various screens in connection with the use of the mobiledevice, e.g., a lock screen, an idle screen, a home screen, anapplication execution screen, a menu screen, a keypad screen, a messagewriting screen, an Internet access screen, a call screen, a game screen,a music play screen, a video playback screen, etc. The display panel 112may be formed of any planar display panel such as LCD (liquid crystaldisplay), OLED (organic light emitting diodes), AMOLED (active matrixOLED), or any other equivalents.

It is noted that, the display panel 112 of this disclosure may provide acamera preview screen and a preview sharing screen for a messenger-basedvideo call service. Related user interfaces are described in detailbelow with reference to FIGS. 3-9.

In some embodiments, the key input unit 120 may include a plurality ofinput keys and function keys to receive user's input actions and to setup various functions. Examples of function keys include navigation keys,side keys, shortcut keys, and any other special keys defined to performparticular functions. Additionally, the key input unit 120 may receive auser's key manipulations for controlling the functions of the mobiledevice 100. The key input unit can create corresponding key inputsignals, and deliver them to the control unit 170. Such key inputsignals may include power on/off signals, volume regulating signals,screen on/off signals, etc. In response to the key input signals, thecontrol unit 170 may send one or more instructions to one or more unitsof the mobile device 100. It is also noted that the key input unit 120may include a QWERTY keypad, a 3*4 keypad, a 4*3 keypad, any otherkeypad formed of many keys with typical or special key arrangement, etc.When the mobile device 100 supports the touch panel 111 in the form of afull touch screen, the key input unit 120 may have only at least oneside key, (e.g., a side key for power on/off, screen on/off, etc.)formed on any side of the body of the mobile device 100.

In some embodiments, the wireless communication unit 130 may performtransmission and reception of signals in connection with a voice call, avideo call, or a data communication. Besides converting various datainto wireless signals, and transmitting them to an external entity, thewireless communication unit 130 may also receive wireless signals fromany external entity and convert them into suitable data. The wirelesscommunication unit 130 may include a mobile communication module (e.g.,a 3-generation mobile communication module, a 3.5-generation mobilecommunication module, a 4-generation mobile communication module, etc.),a short-range communication module (e.g., a Wi-Fi module, a Bluetoothmodule, etc.), and/or a digital broadcast module (e.g., a DMB module,etc.).

The audio processing unit 140 may be formed of a codec (i.e., acoder/decoder) which has a data codec for processing packet data and anaudio codec for processing audio signals such as voice. The audioprocessing unit 140 can convert received digital audio signals intoanalog audio signals through the audio codec and output them through aspeaker (as shown by label SPK in FIG. 1). The audio processing unit 140may also convert analog audio signals received from a microphone (asshown by label MIC in FIG. 1) into digital audio signals using the audiocodec and deliver them to the control unit 170. It is noted that, theaudio processing unit 140 of this disclosure may collect and outputvoice information required for a messenger-based video call service.

In some embodiments, the camera 150 may capture an image and then sendthe captured image to the control unit 170. The camera 150 may include afront camera disposed at the front side of the mobile device 100, and/ora rear camera disposed at the rear side of the mobile device 100. It isnoted that, in this disclosure, the camera 150 is configured to collectimages utilized by a messenger-based video call service. Although notillustrated in the drawings, the camera 150 may include a camera sensorto convert received optical signals into electrical signals and a signalprocessor to convert analog image signals obtained by the camera sensorinto digital data.

The camera 150 of this disclosure may include a camera buffer 151 totemporarily stores image signals received from the camera sensor (forexample, temporarily storing image signals), in a preview mode for agiven time. Such image data temporarily stored in the camera buffer 151may be data used in a messenger-based video call service. For example,when a messenger-based video call service is started, the control unit170 may extract data from the camera buffer 151, convert the extracteddata into a suitable form for a data communication, and controltransmission of the converted data to a messenger server.

The memory unit 160 may store an operating system (OS) of the mobiledevice 100, various applications etc. The memory unit 160 may also storevarious kinds of data created in the mobile device 100, or received fromany external entity (e.g., any external server, other mobile device, PC,etc.). The memory unit 160 may store user interfaces and settingsinformation (e.g., configuration settings information, etc.) inconnection with functions of the mobile device 100.

In this disclosure, the memory unit 160 may store a messengerapplication 161, which refers to a specific application for supporting amessenger function of the mobile device 100. Also, the memory unit 160may store data associated with use of a messenger function while themessenger application 161 is activated. It is noted that, when themessenger application 161 is activated in response to the execution of acamera function, the mobile device 100 may perform a process foraccessing a messenger server according to a user's input or apredetermined schedule. For access to the messenger server, the mobiledevice 100 should be registered in advance with a messenger service and.If the mobile device 100 is not registered in advance, the mobile device100 may perform one or more operations for registration procedure. Whenthe mobile device 100 sends access information to the messenger serverafter activation of the messenger application 161, the messenger servercan authenticate the mobile device 100 based on the access informationreceived from the mobile device 100, and then approves access.

In some embodiments, the control unit 170 can control operations of themobile device 100. For example, the control unit 170 can controls signalflows between different units of the mobile device 100, and processesdata. The control unit 170 may also control power supply from a batteryto different units of the mobile device 100. Additionally, once power issupplied, the control unit 170 may control a booting process, andexecute various kinds of applications stored in the memory unit 160 toperform selected functions of the mobile device 100.

In one embodiment, the control unit 170 may control a menu function toselect or add a messenger member on a camera preview screen, a functionto enter into a messenger-based video call service from the camerapreview screen, a function to transmit or receive a camera preview imagethrough the messenger application, a function to execute a specificfunction of the mobile device such as image capture, a memo input, a mapdisplay, message transmission, voice recording, etc. in a video callenvironment, and a function to create and transmit specific data in avideo call environment. The above mentioned functions of the controlunit 170 in a messenger-based video call service are described below indetail with reference to various screenshots in FIGS. 3-9.

With developments in digital convergence tendencies, the mobile device100 may essentially or selectively further include any other elementssuch as a sensor module for detecting location-based information, a GPSmodule for measuring the location of the mobile device 100, etc.Meanwhile, as will be understood by those skilled in the art, some ofthe above-mentioned elements in the mobile device 100 may be omitted orreplaced with other element(s). Also, the mobile device 100 may furtheror alternatively use any other input unit such as a touch pad,trackball, etc.

FIG. 2 is a flow diagram illustrating example operations of amessenger-based video call service from a mobile device in accordancewith an embodiment of the present disclosure.

At block 210, the control unit 170 (as described above with reference toFIG. 1) detects a user's input for requesting a camera execution. Theflow continues to block 211.

At block 211, the control unit 170 executes a camera function inresponse to the detected input. The flow continues to block 212.

At block 212, the control unit 170 displays on the display panel 112 acamera preview screen to show an image captured by the camera unit 150.The camera preview screen may not necessarily show data stored by imagecapturing, but may represent a screen output on the display panel 112just after passing through image processing and buffering operations.The camera preview screen may be dynamically varied according to achange in an angle of a camera lens. For example, the dynamic variationmay easily allow a user to select a subject and adjust its compositionthrough a dynamic preview image. The flow continues to block 213.

At block 213, the control unit 170 displays on the display panel 112 alist of messenger members in response to a user's input signal. In oneexample, the camera preview screen contains a messenger menu to supporta messenger-based video call service in a camera execution mode. Whenthe messenger menu is selected by the user, the control unit 170retrieves a list of messenger members from the memory unit 160, andoutputs the retrieved list to the display panel 112. The messengermember list may be a list of other device users who accept a previewsharing service. The flow continues to block 214.

At block 214, the control unit 170 detects a selection event forselecting at least one sharer from messenger members in the list. Themobile device 100 can support a multilateral video call service, and theselected messenger members can become sharers for a multilateral videocall in this disclosure. Therefore, at step 215, the control unit 170executes a messenger application to perform a video call service withthe selected sharer, and then accesses a messenger server through themessenger application. Additionally, the control unit 170 may activatethe audio processing unit 140 to send and receive voice. The flowcontinues to block 216.

At block 216, the control unit 170 transmits a request signal for amessenger-based video call service to the selected sharer's mobiledevice. The flow continues to block 220.

At block 220, the control unit 170 displays on the display panel 112 apreview sharing screen to perform a video call based on a messenger. Thepreview sharing screen refers to a user interface screen restructuredfrom the above-mentioned camera preview image so as to support amessenger-based video call. The flow continues to block 221.

At block 221, the control unit 170 receives a response signal foraccepting a video call from any sharer to which the request signal istransmitted. At this time, the control unit 170 may receive voices andimages from the video call sharer. The flow continues to block 222.

At block 222, the control unit 170 performs a video call service whilesharing camera preview images and voices with sharer's mobile device. Inone example, the control unit 170 collects data temporarily stored inthe camera buffer 151 from a time point when the response signal isreceived. Also, the control unit 170 converts the collected data into asuitable form for a data communication and then transmits it as videocall data to a messenger server. The control unit 170 further receivesvideo call data from the messenger server, converts it into a suitableform for the preview sharing screen, and outputs it to the display panel112.

At block 223, the control unit 170 determines whether a request eventfor an additional function is detected in a video call environment. Inthis disclosure, the mobile device 100 can support, in a video callenvironment, a camera control function, an image capturing function, ahandwriting function, a location indication function, a datatransmission function, etc. For example, the control unit 170 may detectan input event requesting the image capturing function in amessenger-based video call environment. In one embodiment, the imagecapturing function, also referred to as a camera shutter function, maybe invoked in response to an input signal from a specific hard key. Inanother embodiment, menu items displayed on the screen may contain ashutter button, and the image capturing function may be invoked inresponse to an input signal from the shutter button.

If a request event for an additional function is detected at step 223,at block 224, the control unit 170 creates data association caused bythe execution of an additional function. For example, in amessenger-based video call environment, the control unit 170 may enterinto an image capturing mode, a handwriting mode, etc. according to auser's selection and then create a photo, a memo, etc. The flowcontinues to block 225.

At block 225, the control unit 170 determines whether to transmit thecreated data to the video call sharer. If there is a request for datatransmission, the control unit 170 transmits the created data to thevideo call sharer at step 226.

After step 226 is performed, or if no request event is detected at step223, the control unit 170 determines at step 227 whether an endingrequest for a video call is detected. In case of no branch at step 225or 227, the control unit 170 may perform operations at block 222. Ifending request for a video call is detected at step 227, the controlunit 170 ends a messenger-based video call and returns to the camerapreview screen at step 228.

Examples of screen interfaces associated with a messenger-based videocall service are described in detail in FIGS. 3-9.

FIG. 3 illustrates example screenshots to select a member for amessenger-based video call service and send a sharing request to theselected member in accordance with an embodiment of the presentdisclosure.

Referring to FIG. 3, the control unit 170 operates in a camera executionmode in response to user's request for a camera function.

As shown in screenshot 301 of FIG. 3, the display panel 112 of the touchscreen 110 displays a camera preview screen 310 thereon under thecontrol of the control unit 170. The camera preview screen 310 may havea view region 311 for showing a real-time image obtained through thecamera unit 160, and camera function key regions including, but notlimited to, a messenger menu button 312 for supporting a video callservice, a home button 313 for changing to the home screen, and ashutter button 314 for capturing an image. Other various buttonsassociated with camera functions may be further used in the camerafunction key regions. The view region 311 shows a real-time previewimage which is obtained, image-processed and buffered through the cameraunit 160. The camera preview screen 310 may be a preview image obtainedthrough a front camera or a rear camera.

While the camera preview screen 310 is displayed, a user can select themessenger menu button 312 to activate a messenger-based video callservice. In response, the touch screen 110 transmits a selection inputsignal to the control unit 170, which extracts identificationinformation about messenger members from the memory unit 160 in responseto the selection signal. For example, the control unit 170 may retrievea buddy list of the messenger application 161.

As shown in screenshot 302 of FIG. 3, the touch screen 110 displays alist 320 of messenger members who have already accepted amessenger-based video call service. The messenger member list 320 maycontain information 321 about at least one member, a list edit menu, acancel button 322, and a done button 323. The messenger member list 320may include a buddy list used in a messenger service. Specifically, thecontrol unit 170 may collect, through the messenger application,information about messenger members whose mobile devices are availablefor a messenger-based video call service, and then offer the messengermember list 320 based on the collected information to the touch screen110. The number of members shown in the messenger member list 320 may bevaried according to user's setting.

A user can select a desired recipient or sharer of a video call from themessenger member list 320. It is noted that, since a multilateral videocall service is available for this disclosure, a user can select one ormore sharers.

After selection, as shown in screenshot 303 of FIG. 3, a user can selectthe done button 323 to perform a messenger-based video call service withthe selected sharer. Then, the control unit 170 transmits a requestsignal for a messenger-based video call service to selected sharer'smobile device, and then communicates if the request been accepted by theselected sharer(s).

Meanwhile, as shown in screenshot 304 of FIG. 3, the touch screen 110may display an addition menu 330 for adding a video call sharer whenthere is no member accepting a messenger-based video call service. If auser selects this menu 330, the touch screen 110 displays a buddy listoffered from a messenger service as shown in screenshot 305 of FIG. 3.Then, a user can select a desired sharer from the displayed buddy listto add it to the messenger member list.

FIG. 4 illustrates screenshots of a connection process for amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

When any sharer is selected for a messenger-based video call service asdiscussed above with reference to FIG. 3, the touch screen 110 displaysa popup window 420 for indicating the progress of requesting aconnection of a video call under the control of the control unit 170 asshown in screenshot 401 of FIG. 4. This popup window 420 may contain acancel button 421 such that a user can cancel a connection request.

When a response signal for accepting a video call from any sharer isreceived, the touch screen 110 displays a preview sharing screen 460under the control of the control unit 170 as shown in screenshot 402 aof FIG. 4. The preview sharing screen 460 refers to a user interfacescreen restructured from the above-mentioned camera preview image so asto support a messenger-based video call.

Before displaying the preview sharing screen 460, the control unit 170executes a messenger application with the selected sharer and thenperforms a connection process to a messenger server. To perform amessenger-based video call service, the control unit 170 may transmitand receive, to and from the video call sharer's mobile device throughthe messenger server, image data outputted on the display unit justafter passing through image processing and buffering. Namely, thecontrol unit 170 enters into a messenger-based video call mode.

The preview sharing screen 460 may contain, but not limited to, a viewregion 411 for showing a camera preview image, a sharer view region 430for showing a sharer's preview image, a home button 440 for returning tothe home screen, an end button 450 for ending a video call, and a camerafunction setting menu 460. Further, the camera function setting menu 460may include menu items for supporting a handwriting mode function, alocation indication function, a camera remote control function, a camerashutter function, etc. in a video call environment. Also, the camerafunction setting menu 460 may support a hiding function and an openingfunction in the view region 411. Based on the number of sharers, one ormore sharer view regions 430 may be displayed at the same time.

The preview sharing screen 410 may be differently configured dependingon whether a mobile device provides or not a call function through amobile communication network. In FIG. 4, screenshot 402 a shows thepreview sharing screen in a mobile device without a call function, andscreenshot 402 b shows the preview sharing screen in a mobile devicewith a call function. In the latter case, the preview sharing screen maycontain a call end button 470, a mute button 471 and a camera switchbutton 472.

Meanwhile, in screenshot 402 a, a sign % S refers to character stringand may be used to indicate the name of a video call sharer.

FIG. 5 illustrates screenshots of an additional camera function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

Referring to FIG. 5, the mobile device of this disclosure may support afunction control of the camera in a video call mode.

A user can select the camera function setting menu 460 on the previewsharing screen 460 shown in FIG. 4. The camera function setting menu 460may include, but not limited to, menu items for a mute control, a screenratio adjustment, a camera switch, a camera shutter button, a camerafunction control authority setting, a map display, a handwriting mode,etc. The mute control menu item is to mute the sound in a video call.The screen ratio adjustment menu item is to adjust a screen ratio of theview region. The camera switch menu item is to perform a switch betweenthe front camera and the rear camera. The camera function controlauthority setting menu item is to authorize a video call sharer tocontrol a camera function. The map display menu item is to support alocation indication function to indicate the location of a mobile devicein a view region. The handwriting mode menu item is to support ahandwriting function in a video call.

As shown in screenshot 501 of FIG. 5, the preview sharing screen may bedisplayed at a specific screen ratio adapted to the touch screen. Forexample, the screen ratio in this case may be 16:9.

When a user adjusts a screen ratio through the screen ratio controlmenu, the screen ratio may be changed as shown in screenshot 502 of FIG.5. For example, if the screen ratio in screenshot 501 is 16:9, thescreen ratio in screenshot 502 may be changed to 4:3.

Display screens shown in FIG. 5 are exemplary only and may be variedaccording to camera function control menu. For example, if a userselects a camera button add menu item in the camera function menu. Then,a camera shutter button may be added to the preview sharing screen, anda user can select the shutter button to capture an image or start avideo recording. Although not illustrated in the drawings, the previewsharing screen may further have a menu item for a toggle functionbetween an image capturing and a video recording. Alternatively, aseparate hard key or button may be used for this toggle function.

FIG. 6 illustrates screenshots of a screen change function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

Referring to FIG. 6, in a messenger-based video call mode, the touchscreen 110 displays the preview sharing screen 610 as shown inscreenshot 601. A user can select the sharer view region 611 on thepreview sharing screen 610. Then, the touch screen 110 may display ascreen layout change menu 620 under the control of the control unit 170.The screen layout change menu 620 may contain menu items of a switchvideo 621 and a hide video 622. The switch video menu item 621 is tosupport a screen change between the sharer view region and the viewregion. The hide video menu item 622 is to support a function to hidethe sharer view region.

A user can select the switch video menu item 621 on the screen layoutchange menu 620 as shown in screenshot 602. Then, the touch screen 620may change the sharer view region and the view region in the previewsharing screen under the control of the control unit 170 as shown inscreenshot 603.

Additionally, a user can select the hide video menu item 622 on thescreen layout change menu 620 as shown in screenshot 602. Then, thetouch screen 620 may remove the sharer view region from the previewsharing screen under the control of the control unit 170 as shown inscreenshot 604. In this case, a voice call function may be stillperformed.

FIG. 7 illustrates screenshots of a camera shutter function and a datatransmission function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

Referring to FIG. 7, when a hiding function of sharer view region isperformed in a video call mode as discussed above, the touch screen 110displays the preview sharing screen without a sharer preview region asshown in screenshot 701.

At this time, a user can select a camera shutter function. For example,the camera shutter function may be performed in response to anactivation of a hard key input. However, if a camera shutter button isadded as a menu item to the touch screen, the camera shutter functionmay be performed in response to a selection of the camera shutter buttondisplayed on the screen. Alternatively, the camera shutter function maybe performed in response to a predefined gesture or voice input.

When the camera shutter function is performed, an image being displayedin the preview sharing screen is captured under the control of thecontrol unit 170. The captured image may be a still image at the timepoint when the shutter button is selected. Also, the captured image maybe reduced in size to a thumbnail image as shown in screenshot 702, andthen may be disposed at the bottom of the preview sharing screen asshown in screenshot 703. And also, a suitable animation effect may beadded as shown in screenshot 702 when the captured image is reduced insize. At the bottom of the preview sharing screen, a send button 721 anda cancel button 722 may be further displayed together with a message forinquiring whether to send the captured image, as shown in screenshot703.

A user can select the send button 721 to send the captured image to thevideo call sharer. Meanwhile, the mobile device of this disclosure maysupport a continuous capturing function in a messenger-based video callmode. When the continuous capturing function is performed, continuouslycaptured images may be overlapped to each other at the bottom of thepreview sharing screen as shown in screenshot 704.

When a user selects transmission of captured image to the video callsharer, the preview sharing screen may display a message for indicatingthe progress of transmission as shown in screenshot 705. Aftertransmission is completed, any related information for indicating thecompletion of transmission may be displayed. In screenshot 706, a sign %N refers to a number and may be used as the number of the sent images.

In another embodiment, a video may be recorded in a messenger-basedvideo call mode and then sent to the video call sharer.

FIG. 8 illustrates a screenshot of a handwriting function and a locationindication function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

Referring to FIG. 8, when a user selects a handwriting menu item in themenu displayed on the touch screen, the mobile device may operate in ahandwriting input mode. Then, the control unit 170 may detect ahandwriting input using a stylus pen or a finger from the touch screen.

As shown, a user can handwrite on the preview sharing screen. Then, thetouch screen 110 may display handwriting data on the preview sharingscreen. The control unit 170 may create video call data includinghandwriting data on the basis of both image data collected by the camerasensor and handwriting data received from the touch screen. Also, usingsuch video call data including handwriting data, the control unit 170may perform a video call with the video call sharer. In response, thevideo call sharer can see the handwriting data on the preview sharingscreen.

Meanwhile, a user can select a location indication function in the menudisplayed on the touch screen. Then, the control unit 170 may obtainlocation information through a GPS receiver of the mobile device,retrieve map information matched with the location information, anddisplay on the preview sharing screen a map that indicates the locationof the mobile device.

FIG. 9 illustrates screenshots illustrating an ending function of amessenger-based video call service in accordance with an embodiment ofthe present disclosure.

Referring to FIG. 9, a user can end a messenger-based video callservice. A video call service end function may be performed in responseto a selection of a relevant end button displayed on the preview sharingscreen. Alternatively, the video call service end function may beperformed in response to a specific hard key input or a predefinedgesture or voice input.

As shown in screenshot 901, a user can select an end button 910. Then,as shown in screenshot 902, the touch screen 110 may display a popupwindow 920 for inquiring whether to end a video call under the controlof the control unit 170. This popup window 920 may contain a cancelbutton 921 and an okay button 922. When a user selects the okay button922, a messenger-based video call service is terminated. Then, the touchscreen 110 displays again the camera preview screen 930 as shown inscreenshot 903.

FIG. 10 illustrates a flow diagram of example operations for a cameraremote control function of a messenger-based video call service inaccordance with an embodiment of the present disclosure.

Referring to FIG. 10, the mobile device of this disclosure may obtain ortransfer a camera function control authority from or to other mobiledevice in a messenger-based video call mode. In other words, the mobiledevice may perform a remote control for camera functions of other mobiledevice or may become a target of remote control by other mobile device.

For illustrative purpose, there are the first mobile device 1010 and thesecond mobile device 1020.

At step 1110, the first mobile device 1010 executes the camera. At step1120, to perform a messenger-based video call, the first mobile device1010 transmits a camera preview sharing request signal to the secondmobile device 1020. Then, the second mobile device 1020 transmits aresponse signal to the first mobile device 1010 at step 1130, andexecutes the camera at step 1140. At step 1152, the first and secondmobile devices 1010 and 1020 perform a video call through a messengerserver on the basis of voice and image information collected through thecamera preview screen. At this time, the first mobile device 1010displays the first preview sharing screen, and the second mobile device1020 displays the second preview sharing screen.

At step 1160, the first mobile device 1010 transmits a control authorityaccept request signal to the second mobile device 1020 in order totransfer a control authority of the first camera to the second mobiledevice 1020. At this time, such a camera control authority may betransferred to a selected sharer in a multilateral call.

At step 1170, the second mobile device 1020 transmits an accept responsesignal to the first mobile device 1010 in order to obtain a controlauthority of the first camera. Then, at step 1180, both the first andsecond mobile devices 1010 and 1020 display the first preview sharingscreen of the first mobile device 1010. The first mobile device 1010merely displays the first preview sharing screen and does not controlcamera functions. Instead, the second mobile device 1020 can controlcamera functions of the first mobile device 1010. Camera functionassociated with this authority may include, but not limited to, an imagecapture function, a focus setting function, a flash determinationfunction, a white balance determination function, a zoom in/out settingfunction, a screen quality and size adjusting function, and a cameracontrol authority cancel function.

The second mobile device 1020 controls functions of the first camera atstep 1190, and transmits these control information to the first mobiledevice 1010 at step 1191. Then, at step 1192, the first mobile device1010 can modify the first preview sharing screen based on the controlinformation received from the second mobile device 1020. Thereafter, inresponse to a camera control authority cancel signal from the firstmobile device 1010 or the second mobile device 1020, the functioncontrol authority of the first camera is transferred again from thesecond mobile device 1020 to the first mobile device 1010.

The above-described embodiments of the disclosure can be implemented inhardware, firmware or as software or computer code that can be stored ina recording medium such as a CD ROM, an RAM, a floppy disk, a hard disk,or a magneto-optical disk or computer code downloaded over a networkoriginally stored on a remote recording medium or a non-transitorymachine readable medium and to be stored on a local recording medium, sothat the methods described herein can be rendered in such software thatis stored on the recording medium using a general purpose computer, or aspecial processor or in programmable or dedicated hardware, such as anASIC or FPGA. As would be understood in the art, the computer, theprocessor, microprocessor controller or the programmable hardwareinclude memory components, e.g., RAM, ROM, Flash, etc. that may store orreceive software or computer code that when accessed and executed by thecomputer, processor or hardware implement the processing methodsdescribed herein. In addition, it would be recognized that when ageneral purpose computer accesses code for implementing the processingshown herein, the execution of the code transforms the general purposecomputer into a special purpose computer for executing the processingshown herein.

While this disclosure has been particularly shown and described withreference to an exemplary embodiment thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the spirit and scope of thedisclosure as defined by the appended claims.

What is claimed is:
 1. An apparatus comprising: a wireless communicationmodule; and a controller, the controller configured to: display an imagereceived from an external apparatus via the wireless communicationmodule, the image captured by a camera operatively coupled with theexternal apparatus; obtain an input to control a function of the camera;generate control information to control the function of the camera basedat least in part on the input; and transmit the control information, viathe wireless communication module, to the external apparatus such thatthe external apparatus control the function of the camera based at leastin part on the control information.
 2. The apparatus of claim 1, whereinthe image comprises a still image or video captured by the camera. 3.The apparatus of claim 1, wherein the controller configured to: receivethe image via a real time video transmitting function that operate basedat least in part on a data communication network.
 4. The apparatus ofclaim 1, wherein the controller configured to: select a messengermember; and connect the external apparatus corresponding to themessenger member, via a data communication network.
 5. The apparatus ofclaim 1, wherein the function of the camera comprises image capturefunction, a focus setting function, a flash determination function, awhite balance function, a zoom in or out setting function, a screenquality and size adjusting function, or any combination thereof.
 6. Theapparatus of claim 1, wherein the controller configured to: receiveanother image, from the external apparatus, captured by the camera basedon condition that the control information was applied to the camerafunction; display the another image.
 7. An apparatus comprising: awireless communication module; a display; and a controller, thecontroller configured to: display an image captured by a cameraoperatively coupled with the apparatus while transmitting the image toat least one external apparatus via the wireless communication module;obtain an input corresponding to at least one portion of the image;generate data based at least in part on the input; and transmit the datato the at least one external apparatus via the wireless communicationmodule.
 8. The apparatus of claim 7, wherein the image comprises a stillimage or video captured by the camera.
 9. The apparatus of claim 7,wherein the controller configured to: transmit the image via a real timevideo transmitting function that operate based at least in part on adata communication network.
 10. The apparatus of claim 7, wherein datacomprises: a handwriting object corresponding to the image, a stillimage captured in response to the input, a video captured in response tothe input, a audio captured in response to the input, locationindication, or any combination thereof.
 11. The apparatus of claim 7,wherein the controller configured to: select a messenger member; andconnect the external apparatus corresponding to the messenger member,via a data communication network.
 12. A machine-readable storage devicestoring instructions that, when executed by one or more processors,cause the one or more processors to perform operations comprising:displaying, at an electronic, an image received from an externalelectronic device via a wireless communication module operativelycoupled with the electronic device, the image captured by a cameraoperatively coupled with the external electronic device; obtaining aninput to control a function of the camera; generating controlinformation to control the function of the camera based at least in parton the input; and transmitting the control information, via the wirelesscommunication module, to the external electronic device such that theexternal electronic device control the function of the camera based atleast in part on the control information
 13. The machine-readablestorage device of claim 12, the image comprises a still image or videocaptured by the camera.
 14. The machine-readable storage device of claim12, wherein the receiving comprises: receiving the image via a real timevideo transmitting function that operate based at least in part on adata communication network.
 15. The machine-readable storage device ofclaim 12, wherein the receiving comprises: Selecting a messenger member;and connecting the external electronic device corresponding to themessenger member, via a data communication network.
 16. Themachine-readable storage device of claim 12, wherein the function of thecamera comprises image capture function, a focus setting function, aflash determination function, a white balance function, a zoom in or outsetting function, a screen quality and size adjusting function, or anycombination thereof.
 17. The machine-readable storage device of claim12, wherein the transmitting comprises: receiving another image, fromthe external electronic device, captured by the camera based oncondition that the control information was applied to the camerafunction; displaying the another image.
 18. A machine-readable storagedevice storing instructions that, when executed by one or moreprocessors, cause the one or more processors to perform operationscomprising: displaying, at an electronic device, an image captured by acamera operatively coupled with the electronic device while transmittingthe image to at least one external electronic device via a wirelesscommunication module; obtaining an input corresponding to at least oneportion of the image; generating data based at least in part on theinput; and transmitting the data to the at least one external electronicdevice via the wireless communication module.
 19. The machine-readablestorage device of claim 18, wherein the data comprises: a handwritingobject corresponding to the image, a still image captured in response tothe input, a video captured in response to the input, an audio capturedin response to the input, location indication, or any combinationthereof.
 20. The machine-readable storage device of claim 18, whereinthe transmitting comprises: transmitting the image via a real time videotransmitting function that operate based at least in part on a datacommunication network.